RATE CONTROL METHOD WITH REGION OF INTERESTING 

SUPPORT 



BACKGROUND OF THE INVENTION 

Field of the invention 

5 The invention relates to a rate control method with region of interesting 

support for increasing the image quality of the region of interesting. 
Description of the Related Art 

Compressing methods are typically used to compress the pictures in order to 
reduce the data amounts, for example coding pictures by MPEG. The basic unit 
10 of coding within a picture is the macroblock. If the sampling is in 4:2:0 format, 
there are six blocks within a macroblock: four Y blocks, one Cb block and one Cr 
block. Each block is first DCT (discrete cosine transform) transformed, and then 
the DCT coefficients have to be quantized into integer. A zigzag scan or other 
alternate scanning method is utilized to arrange the two-dimensional quantized 
15 coefficients into one-dimensional. Finally, a variable-length coding (VLC) is 
employed to do entropy coding. 

The quantization step is where the compression happened. Generally, the 
quantization of a DCT coefficient F[v][u] can be represented as: 

QF[v][u] = 16 * F[v][u] / (Q * W[v][u]) ....(1) 
20 Where the v, u are the indexes for the two dimensional matrix, ranged from 

0 to 7. The Q is the quantizer scale for the blocks within a macroblock, which 
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can be varied for each macroblock. The W[v][u] is a quantization matrix defined 
for the whole pictures, which is used to assign a weighting factor for different 
DCT coefficients. Fig. 1 is a default quantization matrix for intra blocks defined 
in MPEG-2. Referring to Fig. 1, the W[v][u] is getting larger when the v and u 
5 indexes increase. This causes that the quantized coefficients with higher 
frequency more easily becomes zero. This is based on the study of human visual 
system that human is more sensitive to lower frequency signal and less sensitive 
to higher frequency. 

Generally, an encoder treats an image as a single object to encode. The 

10 visual quality of the whole image would be uniform. However, in some 
applications, we would like a dedicate region of the image to be coded with a 
better quality than other region. The surveillance system is a good example. 
Typically, there are multiple cameras connected to a single recording system. 
The images came form these cameras are shrunk and merged into a single image. 

1 5 Thus, a single recording system can be used to record the images of multiple 
cameras. However, if we think that some cameras should have higher priority 
than other cameras, the traditional recording system can't satisfy this requirement. 
Another example is the encoding of video sequence with captions blending onto 
the images. Because the caption is frozen over some images but the background 

20 is moving, the ringing artifact around the caption becomes obviously. If this area 
is given more bit rate, the overall visual quality of the image could become better. 
The region on an image that we want to get a better quality than other region is 
called the region of interesting (ROI). 
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However, because the target bit rate for a video sequence is constrained, and 
thus the bit budget for each picture is a limited resource, how to allocate the bit 
budget for each region according to its priority to achieve the effect of ROI that 
user required is not a trivial problem. 

SUMMARY OF THE INVENTION 

In view of the above-mentioned problems, an object of the invention is to 
provide a rate control method with region of interesting support for increasing the 
image quality of the region of interesting. 

To achieve the above-mentioned object, the rate control method with region 
of interesting support comprises the steps of: 

a) calculating a weighted activity WActJ for each macroblock of the 
current picture according to the priority Pri_i and an activity ActJ of 
each macroblock; 

b) calculating a picture activity Act C for the current picture according to 
the weighted activity WAct_i; 

c) allocating a bit budget BBj for each macroblock according to the 
priority PrM; 

d) calculating an estimated complexity EstCom_C for the current picture 
according to a complexity Com_X of a last coded picture, an activity 
Act_X of the coded picture and the picture activity Act_C; 

e) calculating an estimated quantizer scale EstQC according to the 
estimated complexity EstCom_C and the bit budget BB_C; 
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f) calculating an initial virtual buffer occupancy DO according to a 
reaction factor R_X and the estimated quantizer scale EstQC; 

g) calculating a macroblock quantizer scale Qi for each macroblock 
according to a virtual buffer occupancy of a last coded macroblock, 
the priority Pri_i of each macroblock and the reaction factor R_X; 

h) coding each macroblock according to the macroblock quantizer scale 
Qii and 

i) updating a virtual buffer occupancy Dj of the current coded macroblock 
according to a used bit UB\ of the current coded macroblock, the virtual 
buffer occupancy Dj-i of the last coded macroblock and the bit budget 
BBi of the current coded macroblock. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a default quantization matrix for intra blocks defined in MPEG-2. 

FIG. 2 illustrates a priority table of macroblocks with different priority on 
an image of the present invention. 

FIG. 3 illustrates a quantizer scale table translated from the priority table of 
FIG. 2. 

FIG. 4 is a flow chart for the rate control method with region of interesting 
support of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 
The rate control method with region of interesting support of the present 



4/15 



invention will be described with reference to the accompanying drawings. 

In MPEG, if a macroblock is quantized by a smaller quantizer scale, the 
quality should become better. Therefore, using this character, the present 
invention of rate control method with region of interesting support assigns higher 
5 priority for the region of interesting (ROI) and encodes the macroblocks on the 
ROI with smaller quantizer scale. FIG. 2 illustrates a priority table of 
macroblocks with different priority on an image. In FIG. 2, each block is 
defined as a macroblock and is assigned a priority Prii. For example, the oval 
area is defined as a ROI in the FIG. 2, and priority Pri i at the macroblocks in the 

10 oval area are 2, other macroblocks outside the oval area are 1. FIG. 3 illustrates 
a quantizer scale table translated from the priority table of FIG. 2. In FIG. 3, the 
quantizer scale of macroblocks with priority of 1 is 8, and the quantizer scale of 
macroblocks with priority of 2 is 4, which is half of the quantizer scale of 
macroblocks with priority of 1. Therefore, the macroblocks with priority of 2 

1 5 can get higher quality. 

Based on the bit rate constraint, the encoder allocates a target bit budget for 
a picture. The encoder has to encode each macroblock with a suitable quantizer 
scale so as to control the actually used bits closed to the target bit budget. With 
the requirement of ROI, the encoder has not only to control the bit rate but also 

20 the quality of each macroblock. 

The activity of a picture has to be calculated before actually coding the 
picture. The activity of a picture is the sum of activities of all macroblocks in 
the picture. For an intra-coded macroblock, the activity is the sum of the 
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variance of the four-luminance blocks. For an inter-coded macroblock, the 
activity is the sum of the variance of the four residual blocks. The activity Act 
of a macroblock is then weighted by the priority of this macroblock to become the 
weighted activity WActj. The activity of a picture is actually the sum of the 
5 weighted activity WAct_i of all macroblocks in a picture. After coding a picture, 
the average quantizer scale Avg_Q and the actually used bits UB can be known, 
and the complexity Com of this coded picture is calculated as: 

Com = Avg_Q*UB ...(1) 

After coding a picture of type X (X can be I-, P- or B-picture), the activity 
10 and complexity of this picture is used to update the picture activity of type X 
Act X and the picture complexity of type X Com_X. Using the activity Act_X 
and the complexity Com_X of the previously coded picture of type X and the 
activity Act_C of the current picture, the estimated complexity EstCom_C of the 
current picture of type X can be calculated as: 
1 5 EstCom_C = Act_C * Com_X / Act_X ... (2) 

The estimated quantizer scale EstQ_C of the current picture can be 
calculated as: 

EstQ_C - EstCom_C / BB_C . . .(3) 

where the BB C is the target bit budget allocated for the current picture. 
20 The estimated quantizer scale EstQ C is the default quantizer scale for the 

macroblocks with the priority of 1 . So if a macroblock has a priority of Pri_i, the 
quantizer scale for this macroblock would be EstQ_C / Pri_i. The higher the 
priority is, the lower the quantizer scale for this macroblock. 
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However, the estimated quantizer scale EstQ_C would be not so correct, and 
if we use the fixed EstQ_C to encode the picture, there would be some difference 
between the actually used bits and the target bit budget. A feedback mechanism 
called virtual buffer is employed to control the bit consumption. 
5 A reaction factor R_X for the picture of type X is defined. Typically the 

reaction factor is set as 2 * bit_rate / frame_rate. Before coding a picture of type 
X, the initial virtual buffer occupancy DO is set as R__X / 31 * EstQ_C. The 
target bit budget BB_C is pre-allocated for each macroblock according to the 
weighted activity WAct_i of each macroblock. The encoder encodes each 
10 macroblock i with the macroblock quantizer scale Q\ as: 

Qi = Di_i *31 /R_X/Pri_i ...(4) 

After coding a macroblock i, the virtual buffer occupancy is updated with 
the pre-allocated bit budget BB_i for this macroblock and the used bits UB_i of 
this macroblock: 

15 Di = Di.i+UBJ-BB_i ...(5) 

If the used bit budget UB_i is larger than the pre-allocated bit budget BBi 
for a macroblock, the virtual buffer occupancy increases and the quantizer scale 
Qi for the next macroblock becomes higher. In contrast, if the used bits UB_i are 
smaller than the bit budget BB i, the quantizer scale Qi for the next macroblock 
20 becomes lower. Finally, after coding a picture, the average quantizer scale 
Avg_Q and the used bits UB_C of the current picture are obtained and the 
complexity Com_C for the current picture can be calculated. 

FIG. 4 is a flow chart for the rate control method with region of interesting 
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support of the present invention. Referring to FIG. 4, the steps of the present 
invention includes: 

Step S402: calculate the weighted activity WAcM and the picture activity 
Act_C. First, the encoder calculates the activity Act_i for each macroblock 
5 MB_i and calculates the weighted activity WAct_i according to the priority Pri_i 
and the activity Act_i. For example, the WAct_i = ActJ * Pri_i. Then, the 
encoder calculates the picture activity ActC by summing the weighted activity 
WActJ. 

Step S404: allocate the bit budget BB_i for each macroblock for the current 
10 picture. Allocate the bit budget BB C into bit budget BB_i of each macroblock 
MB_i according to the weighted activity WAct_i. 

Step S406: calculate the estimated complexity EstCom_C and the estimated 
quantizer scale EstQ_C of the current picture. The encoder calculates the 
estimated complexity EstComC according to the activity Act_C of the current 
15 picture, the activity Act_X of the previously coded picture and the complexity 
Com_X of previously coded picture, like the equation (2). Then, the encoder 
calculates the estimated quantizer scale EstQ_C according to the estimated 
complexity EstCom_C and bit budget BB_C of the current picture, like the 
equation (3). 

20 Step S408: calculate the initial virtual buffer occupancy DO. The encoder 

calculates the initial virtual buffer occupancy DO according to the reaction factor 
R_X and the estimated quantizer scale EstQ_C. That is, the initial virtual buffer 
occupancy DO is calculated by the following equation. 
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D0 = R_X/31 *EstQ_C. 

Step S410: calculate the macroblock quantizer scale Qi for each macroblock 
and encode each macroblock. The encoder calculates the macroblock quantizer 
scale Qi according to the virtual buffer occupancy Dm of previously coded 
5 macroblock, the reaction factor R_X and the priority PrM, like the equation (4). 
Then, the encoder encodes the macroblock using the macroblock quantizer scale 

Qi. 

Step S412: update the virtual buffer occupancy Dj. When a macroblock is 
encoded completely, the encoder updates the virtual buffer occupancy Di 

10 according to the virtual buffer occupancy Dm of previously coded macroblock, 
the bit budget BB i of current macroblock and the used bits UB i of the current 
macroblock, like equation (5). 

Step S414: check the coding state. If all the macroblocks are coded 
completely, the encoder jumps to step S416, otherwise jumps back to step S410. 

15 Step S416: update the complexity ComX and activity Act_X. When the 

current picture is coded completely, the encoder updates the complexity Com_X 
according to the used bit UB_C of current coded picture and the average quantizer 
scale AvgQ. Then, assign the activity Act_C of current coded picture to the 
activity Act_X. The complexity Com_X is calculated by the following equation. 

20 Com_X = AvgQ * UB_C. 

While certain exemplary embodiments have been described and shown in 
the accompanying drawings, it is to be understood that such embodiments are 
merely illustrative of and not restrictive on the broad invention, and that this 
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invention should not be limited to the specific construction and arrangement 
shown and described, since various other modifications may occur to those 
ordinarily skilled in the art. 
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